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ABSTRACT 



Brief, motivating television programs, lectures, 
calculation exercises, and laboratory exoeriments were integrated to 
teach a course in applied electronics at the p oyal Institute of 
Technology (Stockholm) . The greater part of the learning work was 
done in the form of independent study checked by diagnostic t^sts. 
These tests proved to have an activating effect on the progress of 
the students, to offer feedback from student to teacher, and to 
provide a basis for continuous revision of the course material. The 
integrated teaching has been given to sophomore students at the 
institute, to teachers at technical colleges, and to industrial 
engineers. The project comprises the production both of software and 
hardware. On the software side are teaching models, textbooks, 
television programs, programed diagnostic tests, examples of circuit 
calculation, and laboratory experiments. On the hardware side are the 
program-controlled feedback system DTA7FST, which contains equioment 
for control and display of multiple-choice tests. An electronic 
responder (ESAU), especially developed for this project, was used for 
collection of responses. (M F) 
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S unroary 



The report describes an experiment in integrated teaching of applied 
electronics. Programme-controlled diagnostic tests with instantaneous 
response collection and taped TV programmes have formed an integrated 
part of the teaching. The integrated teaching has been given to throe 
classes of students at the Royal Institute of Technology (sophrnore 
level, total about 400) and also on concentrated continuation courses 
for teachers at technical colleges and for industrial engineers. The 
project comprises the production both of software and hardware. 

The software side comprises such iters as teaching nod els (for packaged 
courses), textbooks, TV programmes, programmed diagnostic tests, examples 
of circuit calculation, and laboratory experiments. 

The hardware side comprises, among other items, the programme- cent toll ed 
feedback system DIATEST, which contains equipment for control and display 
of multiple choice tests. 

The ESAU responder, specially developed for this project, v;as used for 
collection of responses. 

Programme- con t rol led diagnostic tests, which were initially intended as 
instruments for measuring rtuden s' progress, have proved to have an 
activating effect on their studies. In group teaching these tests permit 
a direct and effective feedback iron student to teacher, and also provide 
a basis for continuous revision of the course material. 

To utilize these advantages of the diagnostic tests, however, high requii 
ments are placed both on test design and on an accurate and detailed 
specification of course objectives. 
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1 . I NTRODUCTION 

The overall aim in the projects that have been and are being run by 
the PE Group of The Royal Institute of Technology is to find effective 
methods for teaching of engineering. 

Process control of teaching is a conceivable alternative, which seems 
a natural choice especially for technological subjects. Technical 
processes are controlled by data which are continuously measured or 
sampled in different steps of the process. In the same way, of course, 
it is possible tc control teaching processes. In technical processes 
there are sensitive elements which measure pressure, temperature, quantity 
etc.; and in teaching process uniquely defined variables are similarly 
required which can be measured by means of different forms of test and 
examination . 

In technical processes homogeneous basic material is available, but this 
is hardly so in teaching. The necessity of flexible adaptation to the 
students' requirements is therefore very much greater in a teaching system 
The process-controlled teaching system is not intended to be run fully 
automatically as in technical processes, It is rather an instrument for 
relieving the teacher of a large part of t lie routine burden, at the same 
time as he receives data of his students' performance which enable him 
effectively to devote his time to individual instruction. 

This report discusses the means of replacing conventional lectures by 
motivating TV programmes and of allowing the greater part of the learning 
work to be done in the form of independent study chocked by diagnostic 
tests. 
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PILOT PROJECT IN SPRING OK 196 S 



2 . 1 Ob jc ctivcs Cor the pi l ot project 
The jro.le^oT lectures 

Trndi tj.onally lectures take up a great part of the scheduled time for 
technological teaching. But experincc shows that, for technological 
students, lectures are the most passive part of the teaching. The purpose 
of the lecture has been to transfer knowledge from teacher to student. 

For large groups of students, however, this transfer of information can 
be done more effectively through other channels, specially through 
textbooks and audio visual media. 

Kypothes is 

Wo therefore set up the following hypothesis: The information transfer 
function of lectures can to a large extent be taken over by suitable 
course literature and their motivating function can be replaced by 
introductory TV programmes. 

Verif ic.itioiw>f the hypothesis 

To verify the hypothesis, a pilot project was instituted covering two 
classes. of students (about 100 in each) taught by two methods, one 
including certain lectures (Method A) and one altogether without conven- 
tional lectures (Method B). In method A, TV programmes were run as repeti- 
tion of the lecture before the circuit calculation exercise. In method B, 
TV programmes were run as introduction to independent study. Knowledge 
has been measured both continuously during the course in the form of 
programme-controlled diagnostic tests and in the form of normal examina- 
t ions. 

tod ii[i£i^ teaching s o<Je I 

An important goal in the pilot project was, on the basis of the experience 
gained, to set up a modified model, Method C, for the regular teaching 
of applif.! electronics. Method C has heen tried out in 1969 for the cL»«s 
in (second-year students. Electrical Engineering) and the results are 
reported helow as project E^-69. 
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To aching in o d e 1 s a n d cours e mat erial of the pilot proj ect 

Experiments in integrated teaching have been made on the Transistor 
False Circuits course in the subject of Applied Electronics at the 
Institute of Technology. (The course earlier comprised 50 h lectures 
and 34 h circuit calculation exercises.) 

Our intentions were to cut down the lecture time to a minimum and replace 
the lectures by brief TV programmes . This necessitates ro inf orcemen t 
of the activity teaching by calculation exercises and laboratory experi- 
ments which are fully integrated with the course, and last but not least 
a continuous follow-up of the results of study. 

To elucidate the role of lectures - or rather the effect of replacing 
them by introductory and motivational IV progra.-nres - two classes were 
taught on two different models, Method A and Method B. Fig. 1 shows 
a comparison between the time schedules for methods A and B and that for 
the previous course. 





Previous 

course 


Method A 
50 Z lectures 


Method B 
0 % lectures 


Lectures 


2x25 


2xl0 x) 


, -- 

lxl0 xx) 


Calculation 








exercises 


2x14 


2x10 


2x10 


Laboratory 








experiments 


2x 3 


3x 6 


3x 6 



x) Every double period consists of 20 nin diagnostic test and 
70 min normal lecturing. 

xx) Consists of diagnostic test, discussion and playback of tape- 
recorded IV programmes . 



Fi g. 1 



Scheduled time for Transistor Fulse Circuits course. 




Method A involves cutting dovr* of the lecturing tine by about 50 Z, while 
in method B there are no convent T rial Krturr.s. In method B there is only 
a short discussion end questions period immediately following the diagnostic 
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The cutting down of lecturing time will he compensated for by the tape- 
recorded TV programmes . Under method A the TV programmes were used for 
repetition of the abbreviated lecture and at the same time as an introduc- 
tion to independent study. 

The course material was divided into one introductory package and ten 
course packages with two written examinations, one after package 6, the 
other after package 11 (Fig. 2). 
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exan 2 



Fig. 2 Division of course into packages and examinations (package 1 is 
preparatory package for the course). 



Each package was given a build-up as shown in fig. 3. 

The goal for each weekly package was specified in the textbook, App. 1 

(sec detailed account in Markcsjo, G»: Tran si s tor pulskre tsar, del 4, 

Norstedts & Seiners For Jag, Stockholm 1963, pp 168-17]). 

Jlie material produced for the Transistor Vulsc Circuits course was as 

f o 1 lows: 

1. Textbook : Markcsjo, C. : TrmisistorpulskroV- n , del 1-4, Norstedts & 
Soncrs Fdrlag, Stockholm 1968 (including examples of exercises in 
circuit calculation and directions for laboratory experiments) 

2. Diagnostic tests programed for fiv< -screen slide projection W 

3. TV programmes produced by 11. Akcsson, TttU (The Committee for Television 
and Radio in Education) (ll) 

4. Exercises in circuit calculation and laboratory experiments. Examples 
of calculation are included in the Textbook, Fart 4. The laboratory 
experiments were designed by K. Kjelkerud and I. Hdglund (4) 
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Method A: one package 
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2.3 Design 

The experiment followed a design proposed by Professor Ake Edfeldt, TRU 
Consultant. Each of the two classes was divided into four exercise groups. 

These groups were taught in accordance with the scheme in fig. 4, from 
which it will be seen also how the course was divided into two halves, 
one comprising packages 2-6, the other packages 7-11. 

The Assistant Teachers rotated between the various groups. The grouping 
was based on ranking of the students according to entrance points. In 
this way we attempted to have both the teachers' time and the student 
material uniformly distributed over the four groups. 





Packages 2-6 




Packages 7-11 




Gr^up 1 


A 




A 




Group 2 


B 


T 


B 


X 


Group 3 


A 




B 




Group 4 


£ 




A 





Pig. 4 Design for teaching of groups 1-4. 

A and B signify teaching method. 

T = examination 



2 . 4 Collected d a ta_ and analysi s 

} The course was moved in 1968 from third year to second year and therefore 

two classes totaling about 230 students, were taught in accordance with 
the above models and design. For course E^ (third year students. Electrical 
Engineering) which started in mid-February, one package was run per week 
during the entire spring term. For course (second-year students, 
Electrical Engineering) two packages were run per week during the later 
part of the term. 
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The following basic data have been collected (variable numbers 1-12 
intended for data processing); 

No. 1 Military group points from Institute of Military Psychology 
enlistment test (only group means indicated in this report) 

2 Entrance points on application to Institute of Technology 

3 Attitude test points after half of course 

4 Attitude test points at end of course 

5 Attendance during packages 2-6 

6 Attendance during packages 7-11 

7 Diagnostic test points, packages 2-6 

8 Diagnostic test points, packages 7-11 

9 Examination points, Calculation Problems, packages 2-6 

10 Examination points, Theory, packages 2-6 

11 Examination points, Calculation Problems, packages 7-11 

12 Examination points, Theory, packages 7-11 

Collected basic data have been analysed in a computer and by other means. 
Basic data have been stored on punched cards, one card for each student. 
BMD programmes programmed for IBM 360-73 have been used. 

A full description of the analysis will be found in Report PK-4. 



2 , 5 Results 

No significant difference between methods A and B was measured in respect 
of examination results. This will be seen from App. 2a. The same applies 
to the diagnostic tests (App. 2b). 

For class is according to App. 2b a correlation factor of the 

order of 0.3 between the examination result (Practical Calculation Problems 
ind the diagnostic tests. 




The correlation between results of diagnostic tests and examination (Theory 
is negative for E y This is because class E^ was credited with the diagnos- 
tic test results &r points towards the theoretical examination. Students 
with good results in diagnostic tests, therefore, did not answer the 
theoretical questions in the examination but devoted all of their time to 
the calculation examination. 
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The final result of the pilot project as regards learning may be summarized 
as follows: 

1. Methods A and B yield the same examination results, which indicates 
that lectures (as in method A) fulfil no major purpose provided that 
textbooks are available and that the students can be kept active by means 
of diagnostic tests. 

2, A weak but positive correlation factor (approx. 0.3) exists between 
the results of diagnostic tests (of multiple choice type) and the calcula- 
tion examination. 

2 . 6 Attitudes, Spring Term 196 8 

The object of teaching is not merely to pass on a given quantity of 
factual knowledge. In the long run its value lies to a large extent in the 
interest aroused in the subject, its principles and methods, and the 
technique required to gather new information about the subject-field. 

The results of teaching can then not be measured only by examinations 
(whether of theoretical or practical calculation type). Attitude measure- 
ments are therefore a necessary complement to pure measurements of know- 
ledge. 

The students in the pilot project in the Spring Term 1968 were given two 
attitude tests, one after package 6 and one after package 11. The tests 
were fairly comprehensive and are described in detail in Report PE-4. The 
results of 3 of the 40 questions in the tests are shown in App. 3. The 
results from E^ and are added together. 

Question 1 shows a very positive attitude for the detailed course specifica- 
tion. A course can be specified in the form of ’’content objectives” or 
"behaviour objectives". Even if the latter is best in principle, the 
students are greatly assisted by a detailed speci f icat ion of content 
objetives issued in advance. 

Questions 2 and 3 show that the TV program's, in the form we have given 
them, are more suited as introduction than for direct learning. As students 
differ in the lengths of tine needed for learning, learning can hardly be 
programmed groupvise from a TV screen (unless use is made of a block field 
or control lable interup tions) . The result is therefore not unexpected. 
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Question 4 shows the need for an extra lecture period (or discussion) 
after the diagnostic test in method B. In the design of method C atten- 
tion has been paid to the attitude results of questions 3 and 4. 

Question 5 shows the difficulties of combining activity teaching and 
preproduced TV programmes. The programmes were of an introductory and 
motivational character and therefore provide too little concrete a basis 
for exercises in circuit calculation. Different means of building feed- 
back into calculation exercises and laboratory experiments will be dealt 
with in a special research project in 1970/71 (financed by the Chancellor 
of the Universities). 
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3 , MAIN EXPERIMENT £ ,, -69 
3. 1 Goa'.s and models 

The objective of the teaching experiment in Transistor Pul* e Circuits was 
to attain a practically usable model for electronics teaching. On the 
basis of the experience from the pilot project in the spring term 1968, 
in which some different models were tried out, a revised model was drawn 
up for use in the regular teaching in the spring term 1969, Method C. 

Method C has been designed with regard both to the results of the attitude 
tests and to the experience gained from the earlier models. 

The diagnostic tests were initially intended only for measurements, but 
soon came to be an integrated part of the learning situation. The posing 
of well prepared questions, which all students had to ansiver and thus 
became actively engaged, while the teacher could directly read the result, 
proved to be both an effective «nd popular form of teaching. 

As, according to attitude questions 2, 3 and 4 (App. 3), in method B the 
students preferred to have an extra lecture period and in method A they 
did not wish to have a repetition of the TV programme , the repetition was 
eleminated and replaced by a prolonged discussion of the diagnostic test. 
This then became method C. 

To fit this method into the schedule, the TV programme for the following 
weak is shown at the end of the 2-hour period (normally devoted to lectures 
allotted for the diagnostic test and its discussion. 

An attempt in to run two packages a week was not very successful, for 

which reason one package a week was run during the 12 weeks of the spring 
terra 1969. 
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Fig. 5 The course package build-up in method C. 



3, 2 Design 



In view of the goal for the main experiment, this experiment was designed 
as a single-group experiment. Experience from the spring erm 1968 
had shown that the rotation of the assistant- teachers and the division of 
the examination into two parts had very negative effects on the students. 
The only special measurements that were made were two attitude tests, one 
about midway through the course and one at the end. Otherwise a compilation 
was merely made of available data such as attendance, diagnostic test 
points and results of examinations. 



3,3 Primary material frcm E ^ -69 

The course has been a regular item for about 130 students in during 
the spring of 1969, Continuous measurements have been made in the form of 
diagnostic tests (DI). The final result was measured by an examination. 

The examination was divided into two parts: a calculation part with 4 
circuit-calculation problems and a theoretical part with 30 multiple choice 
questions. The multiple choice questions are of the same character as the 
DT questions but rather more difficult. 

For the analysis the basic data were divided into the following variables: 
No. 1 Attendance at diagnostic tests 
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of Technology 
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DT result 
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total 
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14 Preparation time 1 



13 . 



Basic data are tabulated in App. 5. 

A detailed specification of the variables is given below, 

No. 1 indicates the number of answered diagnostic tests and varies 
between 00 and 12. 



2-7 are attitude points on the following scale: a = 5, b = 4, c = 5 , 
d = 2, e <= 1, absent = -1. 

2 question 1:1 1 What is your overall impression of this TV 

5 ■ 11 2:1 | teaching compared with average conventional 

teaching? 

a. much better 

b. rather better 

c* neither better nor worse 

d. rather worse 

e. much worse 



3 

6 



4 

1 



question 

u 




As aid for independent study the diagnostic 
test were 

a. very good 

b. fairly good 

c. neither good nor poor 

d. rather poor 
c, very poor 



question 1:15 I 1 considered the calculation excercises 
11 2:2 j a, very good 

b. fairly good 

c. neither good nor poor 

d. rather poor 

e. very poor 



9 DT points. Every correctly answered question gives 1 poit t. 

Wrong answer 0 point. The variable comprises the total points 
from all tests and may vary between 0 and 84, Total ebserce * -1 . 

10 The practical examination consists of 4 problems, each of which 
gives 0-10 points. Examination paper not handed in e -1. 




11 The theoretical examination consists of 30 multiple choice 

questions. Correct answer 0,5 point. The points may vary between 
0 and 15. Examination paper not handed in « -1. 
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12 

13 

14 

15 



Total practical and theoretical points. May vary between 0 and 
55, Examination paper not handed in = -1, 



DT/N = mean result of diagnostic tests. 



Al: 13 
All: 19 



In preparation for each weekly package I have 



read on an average Scale 

a. 0 - 14 min 1 

b. 15 - 29 min 2 

c. 30 - 59 min 4 

d. 1 - 2 h 3 

e. > 2 h 16 



Absence from attitude test indicated by -1, 



3.4 An alysis 

For analysis of the basic data they have been punched on cards (App, 4). 
BMD prograjnmes have been used for the statistical analysis. 

The following analysis were made: 

(3.5) Correlation of basic data for all 186 students starting the course 

(3.6) Study of the significance of attendance for the result of study 
by breakdown into three attendance groups, 



3 . 5 Correlations between basic dat a 

targe parts of the teaching at the Institute of Technology do not involve 
compulsory attendance. It is therefore not necessary to attend all or a 
specific number of diagnostic tests or exercises in the Transistor Pulse 
Circuits course. Certain basic data are thus lacking. 

This must be taken into account in the analysis. In the calculations of 
correlation ve have used a special programs - BMD 03D, Correlation with 
item deletion - so that all available data have been used. Therefore dif- 
ferent numbers of individuals are included in the various calculations of 
correlation. 

It is of interest to see low attendance, DT points and preparation time 
influence the result of the examination. 
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In the first place it may be said that the highest correlations can be 
easily explained, since one variable is included in another* e.g, between 
attendance (1) and DT total (9) or between examination, practical (10) 
and examination* total (12). 

One might perhaps expect that both attendance (1) and high points in the 
diagnostic tests (13) would be reflected in the theoretical examination (11), 
which consists precisely of questions of DT type, but this is not the 
case. (1) and (13) correlate instead with the practical examination. A 
conceivable explanation is that those who do well in DT are generally 
good at electronics and those who get poor DT results spend more time 
reading up the subject, i.e. the feedback from DT functions. 

The correlation between DT (13) and the attitude to DT (3) and (6) increa- 
ses during the course, which may indicate that it takes some time to become 
accustomed to the method of testing. 

Ent ranee . point s to the Institute (8) and DT points (13) both correlate 
with the examination (12), but not with one another, which may indicate 
that they are measures of different kinds of ability. 

The objective of working just hard enough to get through is revealed in 
the negative correlation between entrance points (8) and preparation ti:ne 

< 14 . 15 ). 

In general the course does not appear to match up to the qualifications 
of students who have high entrance points. Their negative attitude (2) is 
reinforced during the course (3). 

If the feedback mechanism with DT functions, there should be no correlation 
between preparation time (14, 15) and result of examination (12). The 
> correlation is also non-existent in this case. The very low correlation 

between DT (13) and theoretical examination (11) points in the same direc- 
tion . 
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3 . 6 I nfluence of attendance 

When a package course has been prepared, with all subject-matter specified 
to particular pages in the textbook, one may question whether the students 
learn the course thanks to or despite the teaching. 

In our case it is interesting to study the degree to which a high level 
of attendance at the diagnostic tests and discussions leads to a better 
result in examinations* 

To study these questions wc divided the material into three roughly 
equalsized groups in respect of attendance: 

group 1 with attendance 1 - 3 times 

" 2 " " 4 - 7 " 

3 n 8 - 12 

With the BMD programme 07D an analysis was made of the distributions of 
the various variables and of the correlation within the groups, and the 
inter-group difference was calculated. 

Missing data were excluded in the same way as in the calculations of 
correlation with BMD-03D. 

Some of the group distributions of the variables arc shown in App. 7* 

The result of the analysis shows that there is a significant difference 
between the groups in the practical examination and also in their attitude 
to the satisfactoriness of the calculation exercises, at least at the 
bcghining of the course (App, 7). 

Those with a high level of attendance at the diagnostic tests do better 
in the practical examination than those with low level of attendance* 

One may thus presume that the teaching in the form of I)T and discussions 
has had the desired positive effect on learning* 

There is a clearly significant positive correlation between the DT results 
(13) and attendance. 

Comparing the correlation between DT (13) and theoretical examination (11) 
within the three groups, it is found that group 1 (low attendance) has a 
negative correlation (-0.40), group 2 slightly positive (+0.20) and group 3 
(high attendance) positive (+0.50), A high level of attendance thus yields 
better results in examinations both during and at the end of the course* 



o 
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Studying the attitudes to the usefulness of DT (3) and (6) one finds that 
those who take part in many DT become more positive to DT as the course 
proceeds. 



3. 7 Attit u des from K ^ -69 

Two attitude tests were run during the spring term 1969, one in February 
after package 5 (AI) and one in May at the end of the course but before 
the examination (All). The results of the tests with distribution of 
answers are shown in App. 8. 

The general attitude to the course (1:1, 11:3) is positive, even if the 
positive attitude falls off somewhat during the course. This is a familia- 
rization effect which was noticeable also in the 1968 pilot project. 

The diagnostic tests are considered to function well (1:2, 11:11). On an 
average they motivate the students for about 1 hour of preparatory work 
(1:13, 11:19), consisting of reading through the week^s material (1:14, 

III 20, 11:10). Considering that students normally read up the courses just 
before the examination, this is a remarkable result. 

One reason for this time devoted to independent study was the clear course 
specification with page references for each package. This course specifi- 
cation was considered a very positive factor and was put to thorough use 
by the students (11:3). 

A more detailed comparison is given below between the questions in the 
first and second tests. Seme questions relating to the diagnostic tests 
form part of a special report to be issued later and are therefore not 
commented on in detail at the present juncture. 
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Comparison between attitude tests I and II for E 9 -69 



(> 



O 



O 



February 



II 

May 



Question No. 

1 1 

11 



10 



11 



12 



13 



\U 



15 



o 

ERsLC 



12 



35 



16 



25 



27 



19 



20 



21 



Comments 

The total impression of the course is positive, though 
slightly less so towards the end of the course. 

DT ara satisfactory; more positive attitude at beginning 
than at end 

Pace of TV programmes rather toe fast, especially towards 
the end of the course 

Quantity of information in the TV programmes reasonable 

The adaptation of the TV Leaching to the students"' level 
of knowledge is considered to diminish during the course. 
This may be because t?io difficulty of the course increase ; 
towards the end. 

The TV programmes are considered rather too short. 

Five-screen slide projection better than TV for display of 
diagnostic tests 

The time allowed for answering of the diagnostic test 
questions was at large considered to bo sufficient. 



DT should be commented on preferably by going through each 
alternative, including the distractors. 

If a package were to be repeated, the only preference is 
for the conventional lesson. This may be because the courr; 
is rat tier too difficult and would therefore n.»cd no re 
exp lanat ion. 

The usefulness of the laboratory exercises was considered 
quite satisfactory , an opinion which was reinforced as the 
course proceeded. 

The difficulty of the laboratory experiments vus coasidcie 
reasonable \ their difficulty should perhaps be increased 
as the course proceeds. 

The average preparation tine, 1 hour, diminishes slightly 
during the course. 

The r*>t iva t i < ■> for preparatory vnrV shift ^ slightly iron 
T, to get through L*T n to M normal ricthod of study”. 

The calculation exorcises veto ncdiocre but i improved. 

The course specification was of great use. 



3 
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I II 



r 

V 

{* 



0 



February Kay 

Question No. 

4 

5 

6 
LO 

13 

14 

17 

18 

22 

23 

24 

26 

28 



Comments 

The calculation exercises and laboratory experiments are 
the elements which chiefly need to be improved. 

The theoretical part of the TV programme should be repeated 
before the calculation exercises. 

DT necessitate seme preparation before the lesson, and this 
is considered a positive factor by many students. 

The feedback from DT is considered to function, 



Practically no student is disturbed by the fact that the 
others can see his DT score during the test. 

Easy to follow onc"s own score on the ESAU display. 

The calculation exercises should possibly contain more 
theory. 

The calculation exercises have covered a reasonable number 
of problems. 

The difficulty of the calculation exercises has been modes :i 
to rather too difficult, 

A generally reasonable number of laboratory experiments. 

The students have received sufficient help in the laboratory 
experiment s . 



O 
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3. 8 Experience from use of different response collection systems 

In the development of teaching models and systems the feedback technique 
is of the greatest significance. There are different types of feedback 
from the diagnostic test: 




indicates improvement 

where further 
instruction 
is needed 



Fig. 6 The diagnostic tests give three types o£ feedback. 



1. to students, who can thereby better plan their studies 

2. to the teacher, who can thereby give both better individual and group 
instruction 

3. to the course developer, who thereby obtains an effective basis for 
revision of the course material. 



To obtain feedback, suitable measuring data must be collected and processed 
into an interpre table result. 



In the integrated teaching of applied electronics the actual measuring 
instrument has been developed in the foim of piogratnncd diagnostic tests of 
roiltiple choice type ( 2 ). 




There are several ways of collecting the answers from these tests. The 
choice of method will depend on the type of feedback desired .and the cost 
that can be accepted. 




The types of response collection that we have used are: 

1. Template-corrected answer forms 

2. Respondex, Elopin system (multiple choice mentometer type) 

3. ESAU, electronic responder with individual response co" lection 

4. Optically read response cards for correction in a computer (Service 
Group for Optical Scanning, SOL, former KLP Group). 

In the first term in which the course was used the main object of the 
tests was to collect data for evaluation of the function of the TV program 
mes in the teaching model under trial. We then used template-corrected 
answer forms, the result from one week being discussed in the following 
week. Correction and item analysis were done by hand and took rather a 
long time. 

But it soon became clear that some form of instantaneous electronic 
response collection would be desirable for quicker feedback. 

A specification for an electronic responder (ESAU) was then drawn up in 
collaboration with Gerhard Westerberg, who later developed the prototype 
of ESAU, the cost of which were borne by the TRU Committee. 




. 8 The electronic responder ESAU with central unit and TV-display. 

The central unit is here operated by the designer Gerhard Westerberg. 
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ESAU was used for the first time cn a refresher course for teachers in 
August 1969 and met with a very positive reception. The diagnostic tests 
met with a very favourable response in their attitude test. The teachers 
also expressed a desire to use the DT technique in their ovn classes. 

Another system, Respondex, was used for the same group of teachers. This 
merely shows the numbers of answers under each alternative, which suffices 
for the student and teacher, but one loses the information for the item 
analysis which is of value to the question designer, 




Fig. 9 The Respondex system only gives total scores on each alternative 
A - D. 



ESAU was then used on a regular basis in the Transistor Pulse Circuits 
course in the spring term 1969. The quick recording of answers meant that 
the DT questions could be used in a new and more active manner. Each 
question was immediately followed by comments on the correct alternative 
and the distractors. 

The time taken on discussion of each question was adapted to the result, 
and more time could therefore be given to unclear points. To facilitate 
the running of the tests, a control system was developed which both control- 
led the display of questions and issued scanning orders to ESAU. The new 
system, DIATEST, was run with good results during the aututm of 1969 for 
in the linear course. 
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Fig. 10 A diagnostic test run with ESAU* After each question the 
alternative answers are discussed in detail. 



One might think that courses based on well programmed material and contai- 
ning diagnostic tests for check of learning would run pretty well under 
their own steam. That this is not so is shown by the Transistor Pulse 
Circuits course in the spring of 1970. The course was run with temporarily 
deputizing teachers (four teachers took part) and with different types of 
response collection in the diagnostic tests, as during certain periods ESAU 
was unavailable, being under trial for other assignments. 

At half-term the students reacted against this arrangement and demanded - 
and obtained - the conventional lecturing. 

A contributory reason may be that the course is relatively difficult, as 
shown also by attitude tests in previous years. 
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The attitude to this course indicates that programed courses with DT 
require accustomed teachers and sufficient time for the students to become 
familiar with the apparatus. 

Responder systems of ESAU type arc probably still too expensive for the 
broad educational market, and in particular they are not available in 
schools today, so that other forms of response collection must be used. 

The same applies to the examinations which ve have run with multiple choice 
questions, in which the cheating risk is all too great with ESAU. Ve have 
therefore used the SOL (Service Group for Optical Scanning) system with 
optically read answer forms which are processed in a computer. The correc- 
tion programme includes an extensive item analysis. 

The design of good questions is difficult and takes much time. Wc have 
therefore developed a questions bank in which the questions and their iton 
analysis are collected. New questions are successively added to the bank 
in collaboration with other institutes. The work on the questions bank will 
be dealt with in a separate report. 



LiirJLL 
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Next page shows an example of an answer form for optical 
scanning used by the SOL Group. 
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4, ECONOMY 



The PE Group project with "integrated teaching of Transistor Pulse Circuits" 
must be regarded as a research and development project of new and partially 
untried methods. The costs of the project can therefore not be said to be 
representative of regular teaching with integrated feedback and computer 
follow-up of the results. 

To give some idea of the costs and investments involved in a development 
project of this type, the six largest items of expenditure are tabulated 
below. 





1000 


"s of kronor 


1. 


Swedish Board of Technical Development grant for 
development of methods 


225 


2. 


4 textbooks at 50,000 kr 


200 


3. 


ESAU prototype, cost borne by YRU Committee 


100 


4. 


15 TV programmes at 15,000 kr 


225 


5. 


TV installations (Chancellor of the University) approx. 


150 


6. 


New investment in laboratory (os ci 1 loscopcs) (Ins ti Lute 
of Technology ana Division of Applied Electronics) 


100 




Total approx. 


1 mill ion kr 



The investments trade in this project by different organizations and 
companies have brought a dividend in different forms. 

1. The Swedish Board of Technical Development grant was necessary for the 
development of methods and follow-up of knowledge and attitude results in 
pilot and main projects. The methods have partially served as a pattern 
for other projects at the Institutes of Technology in Stockholm and Lund. 
P rogramme-cen t rol led multiple choice systems are now used within the 
Divisions of Physical Metallurgy and Electiic.il Engineering at the 
Institute of Technology in Stockholm, and packaged courses have been 
further developed at the Division of Applied Electronics at the Institute 
of Technology in Lund, 




Programme- co it tol led diagnostic tests wove originally introduced as a 
measuring instrument in the TV teaching of Transistor Pul go Circuits, but 
are now an integrated part of the teaching. 
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The methods for diagnostic follow-up have been tested ou a large scale in 
a project run jointly with the Swedish Broadcasting Corporation and the 
teaching aid producing company Laromedelsforlagen. 

As appears from the half-year report of the PE Group (Jan. - „une 1970) 
the methods developed have met with a great interest both among technicians 
(for continuation courses within industry) and among educat ionalis ts . The 
methods have been presented at a number of conferences and in lectures at 
the request of various interested parties. 

The development project may therefore be said to have a value as a model 
for similar teaching systems* which justifies the grant made by the Board 
of Technical Development. This grant represented a forward-looking invest- 
ment in a field in which the Board had earlier had little experience. 

2. Ninety per cent of the textbooks have been sold outside the Institute of 
Technology, which justifies the publisher's investment. 

3. The firm Eumalampan lias taken up the manufacture of ESAU, which will 
partially compensate the TRU Committee for its investment in the prototype* 

4. The IV programrnes have been used at the Institutes of Technology in 
Stockholm, Linkoping and bund. Several upper secondary schools (Class 4, 
Telecorciiunicat ions Lino) could have made use of these programmes. Unfor- 
tunately these schools have been unable to obtain copies of the tapes from 
the TRU Committee (although no copyright objection exists). From the 
economic aspect it is regrettable that the TV production as early as 
February 1968 has not been put to wider use despite a considerable demand, 

-S. The installation of TV monitors, cabling, video tape recorders and intercom 
telephones in lecturing rooms in the old Electrical Engineering wing at 
the Institute of Technology must be partially jegarded as a test of suitable 
equipment and cannot be charged in its entirety to the teaching of applied 
electronics* The installation has later been used for regular TV teaching 
also of other subjects. 




6. The change to parallel running of the laboratory experiments in applied 

electronics was done on pedagogical grounds. This investment would soon have 
become necessary even if no development project had been under way. The role 
of the TV project in this respect was chiefly to accelerate an inevitable 
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5. FINAL SUMMING UP 

The experiment in integrated teaching of Transistor Pulse Circuits shows 
that lectures can very well be replaced by introductory TV progranmes and 
independent scudy checked by diagnostic tests. A condition for effective 
integrated teaching is a clearly formulated course specif ication and care- 
fully designed diagnostic tests. To facilitate the t acher^s work these 
tests should be programme-controlled and there should be means for quick 
correction. 

Properly designed diagnostic tests can be used by the student for checking 
the results of his studies, by the teacher for adjusting his teaching to 
the needs of the students, and by the course developer for revising the 
course material. Automatic methods for display of questions, recording of 
answers, and data processing of the results are essential if the teaching 
is to be process-controlled. 

Experience from the programme-controlled D1ATEST system has been very pro- 
mising in this respect. 

Altogether three classes of technologist students have taken part in the 
experimental teaching. Preliminary results from the two courses in the spring 
of 1968 have been published in the PE Group Report PE-4 (in Swedish) , and 
the DIATEST system has been described in Report PE-7 (in English). The ESAU 
response analyser has been dealt with in two articles [6, 7). 

In a later project - a report of which is expected to be published in the 
autunn of 1970 - experience will he given of an experiment in process- 
controlled teaching on a large scale in Class 4 of upper secondary school* 

A third project may possibly deal with the means of measuring activity and 
creativity elements in the teaching process* Such measurements consitute 
a condition for a more just evaluation of the work done by students and of 
the results of their studies* 
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E xamination results, Spring Term 1968 



Exam 1 Exam 2 



Group 


X 


0 


X 


0 


n 


1 


L._13 


0.48 


2^06 


0.32 


20 


2 


1.16 


0.43 


1.08 


0.68 


20 


3 


1. 16 


0.40 


0.96 


0.70 


20 


4 


0.97 


0.44 


0^90 


0.82 


22 



Second-year 



course 



Exam i Exam 2 



Group 


X 


J 


X 


0 


n 


1 


1.01 


0.36 


1.07 


0.78 


24 


2 


1.08 


o 

u- 

Ln 


0.93 


0.64 


26 


3 


_ 1 J )8 


0.39 


0,88 


0.64 


2 / 


4 


1.07 


0.43 


1.12 


0.63 


23 



Thi rd-ycar 



course K 3 



Standardized group means of points i:i the two examinations. 
(Relate to students who have taken part in both examinations.) 
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DT results and correlatio ns, bpring Term 1968 



Packages 2-6 Packages 7-11 Entrance points 



Group 


X 


a 


X 


0 


X 


1 


0.90 


0.46 


1.05 


0.45 


44.69 


2 


1.05 


0.48 


0.95 


0.52 


45. 19 


3 


0.96 


0.43 


1.00 


0.52 


42.28 


4 


1.06 


0.47 


0.98 


0. 54 


45.84 



Second -y en r 



course 



Packages 2-6 Packages 7-11 Entrance points 



Group 


X 


0 


X 


0 


X 


1 


1.04 


0.47 


0.90 


0. 44 


44.57 


7 


0.93 


0.46 


1.15 


0.40 


44.61 


3 


1.06 


0.35 


1.16 


0.40 


41.96 


lZI 


0.91 


0.41 


0^75 


0.46 


41.51 



Third-yea r 



co urse K ^ 



Standardized DT results added together into half-term values. 
Method A underlined. 



Correlation between 
DT and Exam 


f; 2 


F 3 


2-6 


I practical calculation 


0. 31 


0.41 


2-6 


I theoretical 


0.34 


-0.10 


7-11 


11 practical calculation 


0 . 2? 


0.00 


7-11 


11 theoretical 


0 . is 


-0.62 



o 

ERIC 



Coefficients of correlation between DT results and examination results. 
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A tti t u die from pi lot pr oj ect , Spring T e an I ‘1 fs 8 
(for ^2 2nd 1 '^ combined) 
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1. The specification of the course objectives to particular pages for each 



er|c 



package was an aid which f utilized 

a) every time 

b) usually 

c) sometimes 

d) occasionally on trial 

e) not at all 

(Question 1 relates to :>.? thuds A 
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The replacement of a lecturing period n a i -.- pot : ! i on of the TV p cogramme 

would, 1 consider, be i 



a) much better 

b) rather better 

c) neither better nor worse 

d) rather worse 

e) much worse 

(Question 2 relates solely to method A) 

Being able to see the IV programme bef lo reading the textbook was, 

1 consider, 4 

— — ” 

a) much better 

b) rather better 

c) neither better nor worse 

d) rather worse 

e) much worse 

(Question 3 relates solely to method B) 

To add an extra lecturing period between diagnostic test and IV programme 
would be, I consider, L 

a) much better 

b) rather better 

c) neither better nor worse 

d) rather u’orso 

e) much v^urso 
(Question 4 relates solely to method 13) 

The ability of the TV teaching to provide a bis is for the circuit calculation 
exercises was | 

a) very good 

b ) fairly good 

c) neither good nor poor 

d) rather poor 

e) very poor 

(Question 5 relates solely to method A) 





App. 4 



Posi tions o f basic dat a on p u nched card, K^~ 
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Variab le 



Positions ci 



class + year 



1 - 6 



1 


national registration number 
presence at DT and lectures 


7 

17 




16 

18 


2 


Attitude I to the course 


19 




20 


3 


" I value of DT 


21 


- 


22 


4 


n I circuit calculation exercises 


23 


- 


24 


5 


Attitude 11 to the course 


25 


- 


26 


6 


11 II value of DT 


27 


- 


28 


7 


II circuit calculation exorcises 


29 


- 


30 


8 


Entrance points tc Institute of Technology 


31 


- 


34 


9 


DT points, total 


35 


- 


36 


10 


Examination, practical calculation 


37 


- 


39 


11 


" , theoretical 


40 


- 


42 


12 


" , total 


43 


- 


45 


13 


DT points, mean 


46 


- 


47 


14 


Preparation time I 


48 


- 


49 


15 


" "II 


50 


- 


51 



r 



o 

ERIC 






card 



Bilaga 5 



Variable No . 



PRIMARY DATA FROM E 2 ~69 



1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


11 


3 


4 


3 


4 


5 


3 


4675 


61 


32,0 


14,0 


46,0 


5,5 


3 


2 


00 


-1 


-1 


-1 


-1 


-1 


-1 


5150 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


11 


1 


3 


3 


1 


2 


1 


4625 


41 


0,0 


8,0 


8,0 


3,7 


8 


16 


07 


4 


4 


4 


-l 


-1 


-1 


4300 


27 


6,0 


13,5 


19,5 


3,9 


1 


-1 


07 


4 


4 


4 


-1 


-1 


-1 


4875 


32 


0,0 


11,0 


11,0 


4,6 


16 


-1 


01 


-1 


-1 


-1 


-1 


-1 


-l 


4875 


02 


-1 


-1 


-I 


2,0 


-1 


-1 


04 


5 


4 


2 


-1 


-1 


-1 


5025 


25 


-1 


-1 


-1 


6,3 


2 


-1 


00 


-1 


-1 


-1 


-1 


-1 


-1 


4250 


-1 


-1 


-1 


-I 


-1 


-1 


-1 


12 


4 


4 


3 


4 


5 


4 


-1 


71 


27,0 


14,5 


41,5 


5,9 


2 


2 


07 


4 


2 


1 


2 


2 


3 


4725 


27 


9,0 


10,0 


19,0 


3,9 


2 


2 


07 


-1 


-1 


-1 


4 


5 


3 


4800 


22 


16,0 


22,0 


38,0 


3,1 


-1 


2 


04 


2 


4 


2 


-1 


-1 


-1 


5375 


17 


14,0 


9,5 


23,5 


4,3 


4 


-1 


04 


-1 


-1 


-1 


-1 


-1 


-1 


4675 


09 


7,0 


9,0 


16,0 


2,3 


-1 


-1 


10 


4 


3 


4 


1 


1 


5 


4 700 


42 


32,0 


10,0 


42,0 


4,2 


16 


S 


09 


4 


5 


3 


4 


4 


3 


4750 


45 


20,0 


14,0 


34,0 


5,0 


8 


8 


09 


5 


4 


2 


3 


4 


4 


47 75 


49 


20,0 


11,5 


31,5 


5,5 


8 


12 


10 


4 


4 


4 


4 


3 


2 


4700 


41 


23,0 


9,5 


32,5 


4,1 


8 


16 


00 


-1 


-1 


-1 


-1 


-1 


-1 


4850 


-1 


20,0 


10,5 


30,5 


-1 


-1 


-1 


06 


2 


5 


5 


2 


4 


2 


4925 


27 


-1 


-1 


-1 


4,5 


1 


1 


01 


-1 


-1 


-1 


3 


3 


2 


4700 


03 


0,0 


6,5 


6,5 


3,0 


-1 


1 


06 


4 


4 


2 


-1 


-1 


-1 


4725 


23 


-1 


-1 


-1 


3,8 


4 


-1 


07 


4 


3 


1 


2 


1 


2 


4825 


29 


-1 


-1 


-1 


4,1 


8 


16 


12 


4 


4 


3 


3 


4 


4 


5175 


56 


19,0 


12,5 


31,5 


4,3 


4 


6 


03 


3 


4 


3 


-1 


-1 


-1 


4250 


08 


-l 


-1 


-1 


2,7 


2 


-1 


06 


3 


-1 


4 


4 


-1 


4 


4900 


33 


33,0 


14,0 


47,0 


5,5 


8 


4 


01 


-1 


-1 


-I 


-l 


-1 


-1 


4675 


05 


10,0 


n,5 


21,5 


5,0 


-1 


-1 


11 


4 


4 


4 


4 


4 


4 


4425 


42 


0,0 


8,0 


8,0 


3,8 


4 


4 


00 


-1 


-1 


•1 


-1 


-1 


-1 


4375 


-l 


9,0 




16,5 


-1 


-1 


-1 


11 


4 


4 


4 


3 


4 


4 


5050 


39 


20,0 


9,0 


29,0 


3,5 


4 


4 


01 


-1 


-1 


-1 


2 


3 


3 


-1 


05 


-1 


-1 


-1 


5,0 


-1 


1 


03 


-1 


-1 


-1 


-1 


-1 


-1 


4875 


10 


-1 


-1 


-1 


3,3 


-1 


-1 


03 


-1 




-1 


-1 


-1 


-1 


-l 


08 


13,0 


10,5 


23,5 


2,7 


-1 


-1 


01 


3 


4 


1 


-l 


-1 


-1 


47 75 


02 


-1 


-1 


-1 


2,0 


2 


-1 


00 


-1 


-1 


-1 


3 


3 


2 


492 5 


-1 


-1 


-l 


-1 


-1 


-1 


l 


& 


4 


5 


3 


4 


4 


2 


4475 


31 


11,0 


11,5 


22,5 


4,4 


4 


2 


tic 


-1 


-1 


-l 


-1 


-1 


-1 


4400 


-l 


-1 


-l 


-l 


-1 


-1 


-1 



M) 



11 


4 


4 


4 


4 


4 


4 


4600 


04 


2 


5 


3 


2 


4 


2 


5100 


06 


2 


5 


2 


-1 


-1 


2 


4475 


00 


-1 


-1 


-J 


-1 


-1 


-1 


4266 


10 


3 


4 


3 


-1 


5 


3 


4675 


09 


4 


4 


3 


4 


4 


4 


4566 


12 


4 


4 


3 


4 


3 


3 


4275 


03 


-1 


-1 


-1 


3 


3 


1 


4525 


OB 


-1 


-1 


-1 


-1 


-1 


-1 


4700 


11 


4 


4 


4 


4 


4 


4 


4525 


09 


4 


3 


2 


4 


4 


2 


4650 


05 


4 


4 


2 


3 


2 


4 


5000 


03 


4 


4 


2 


4 


4 


4 


4450 


08 


4 


3 


4 


4 


3 


4 


5500 


05 


-1 


-1 


-1 


4 


5 


4 


4850 


00 


-1 


-1 


-1 


-1 


-1 


-1 


4250 


05 


-1 


-1 


-1 


4 


4 


4 


5025 


00 


-1 


-1 


-1 


-1 


-1 


-1 


5050 


01 


3 


4 


1 


-1 


-1 


-1 


-1 


09 


4 


2 


5 


4 


»1 


3 


4475 


01 


4 


5 


2 


3 


4 


3 


4650 


05 


5 


2 


2 


-1 


-1 


-l 


4500 


08 


1 


4 


4 


2 


5 


4 


4725 


02 


•1 


-1 


-1 


-1 


-1 


-1 


-1 


07 


-1 


-1 


-1 


4 


4 


4 


4650 


10 


4 


4 


3 


4 


4 


5 


4500 


03 


-1 


-1 


-1 


4 


4 


4 


4525 


00 


-1 


-1 


-1 


-1 


-1 


-1 


5100 


06 


4 


5 


4 


-1 


-1 


-1 


4550 


01 


-1 


-1 


-1 


-1 


-1 


-1 


5525 


01 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


12 


3 


5 


4 


4 


5 


3 


4566 


05 


-1 


-1 


-1 


-1 


-1 


-1 


4925 


07 


5 


5 


3 


4 


5 


2 


4850 


07 


3 


5 


3 


4 


4 


4 


-1 


01 


4 


5 


2 


-1 


-1 


-1 


4650 


01 


-1 


-1 


-1 


3 


5 


3 


4200 


11 


3 


4 


3 


3 


4 


4 


-1 


03 


5 


5 


3 


-1 


-1 


-1 


-1 


00 


-1 


-1 


-1 


-1 


-1 


-1 


-l 


07 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


o 00 

ERLC 


-1 


•1 


-1 


- L 


-I 


4 


-1 



49 


15,0 


12,0 


27,0 


4,5 


8 


3 


15 


-1 


-1 


-1 


3,8 


2 


2 


22 


0,0 


0,8 


0,8 


3,7 


2 


2 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


48 


20,0 


13,0 


33,0 


4,8 


4 


4 


37 


3,0 


11,0 


14,0 


4,1 


4 


4 


48 


20,0 


11,5 


31,3 


4,0 


8 


L 6 


10 


9,0 


12,0 


21,0 


3,3 


-1 


1 


36 


-1 


-1 


-1 


4,5 


-1 


-1 


52 


20,0 


12,0 


32,0 


4,7 


3 


3 


30 


0,0 


10,5 


10,5 


3,3 


2 


2 


16 


-1 


-1 


-1 


3,2 


4 


1 


17 


5,0 


11,5 


16,5 


5,7 


8 


16 


25 


31,0 


13,5 


44,5 


3,1 


1 


1 


13 


M 


11,3 


15,5 


2,6 


• 1 


2 


-1 


-1 


-1 


-1 


-1 


■■1 


-1 


22 


27,0 


11,5 


38,5 


4,4 


-1 


8 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


06 


0,0 


8,5 


8,5 


6,0 


4 


-1 


34 


0,0 


9,5 


9,5 


3,8 


2 


4 


07 


3,0 


8,5 


13,5 


7,0 


8 


4 


19 


-1 


-1 


-1 


3,8 


16 


-1 


43 


28,0 


12,0 


40,0 


5,4 


8 


4 


09 


18,0 


13,0 


31,0 


4,5 


-1 


-1 


27 


10,0 


11,0 


21,0 


3,9 


-1 


4 


47 


0,0 


12,5 


12,5 


4,7 


2 


2 


11 


3,0 


11,0 


14,0 


3,7 


-1 


8 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


29 


11,0 


11,0 


22,0 


4,8 


8 


-1 


06 


-1 


-1 


-1 


6,0 


-1 


-1 


02 


10 , c 


23,0 


33,0 


2,0 


-1 


-1 


70 


12,0 


14,5 


26,5 


5,8 


3 


8 


05 


4,0 


7,0 


11,0 


1,0 


-1 


'1 


32 


22,0 


20,0 


42,0 


4,6 


3 


4 


28 


14,0 


12,0 


26,0 


4,0 


8 


8 


03 


18,0 


10,0 


28,0 


3,0 


-1 


-1 


04 


-1 


-1 


“1 


4,0 


-1 


8 


55 


29,0 


13,0 


42,0 


5,0 


8 


4 


10 


0,0 


6 , 3 


6,5 


3,3 


8 


-! 


-I 


-1 


-1 


-1 


-1 


-1 


-1 


15 




-1 


-1 


2,1 


•1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 



n 



06 


-1 


-1 


-1 


4 


4 


4 


4725 


22 


10,0 


8,0 


18,0 


3,7 


-1 


2 


05 


3 


4 


1 


-1 


-1 


-1 


4250 


21 


-1 


-1 


-1 


4,2 


8 


-1 


01 


-1 


-1 


-1 


-1 


-1 


-1 


4750 


06 


-1 


-1 


-1 


6,0 


-1 


-1 


11 


4 


4 


4 


4 


4 


5 


4266 


52 


10,0 


13,0 


23,0 


4,7 


8 


8 


00 


-1 


-1 


-1 


-1 


-L 


-1 


4500 


~1 


-1 


-1 


-1 


-l 


-1 


-1 


11 


4 


5 


2 


3 


4 


2 


5000 


49 


17,0 


10,5 


■ 17,5 


4,5 


2 


2 


07 


3 


4 


3 


-1 


-1 


-1 


4300 


26 


0,0 


12,0 


12,0 


3,7 


2 


-1 


06 


-1 


-1 


-1 


4 


4 


2 


4625 


21 


0,0 


9,0 


9,0 


3,5 


-1 


4 


06 


4 


4 


4 


4 


4 


4 


4850 


28 


20,0 


12,5 


32,5 


4,7 


2 


2 


07 


2 


3 


3 


3 


3 


4 


4875 


13 


-1 


-1 


-1 


2,9 


1 


1 


04 


-1 


-1 


-1 


2 


1 


2 


4950 


12 


-1 


-1 


-1 


3,0 


-1 


1 


08 


4 


5 


2 


5 


4 


2 


4575 


42 


29,0 


10,5 


39,5 


5,3 


16 


4 


09 


-1 


-1 


-1 


-1 


-1 


-1 


4350 


28 


11,0 


10,5 


21,5 


3,1 


-1 


-1 


04 


2 


4 


4 


1 


4 


4 


5025 


18 


27,0 


12,5 


39,5 


4,5 


4 


2 


08 


-1 


-1 


-1 


-1 


-1 


-1 


4650 


27 


17,0 


11,0 


28,0 


3,4 


-1 


-1 


00 


-1 


-1 


-1 


-1 


-1 


-1 


5100 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


05 


4 


5 


4 


3 


5 


3 


4275 


18 


15,0 


10,5 


25,5 


3,6 


8 


8 


11 


3 


2 


4 


1 


3 


3 


5225 


36 


20,0 


12,5 


32,5 


3,3 


4 


2 


08 


-1 


-1 


-1 


-1 


-1 


-1 


4525 


29 


0,0 


6,5 


6,5 


3,6 


-1 


-1 


00 


-1 


-1 


-1 


-1 


-1 


-1 


4650 


-1 


-1 


-1 


-] 


-1 


-1 


-1 


06 


1 


4 


1 


1 


1 


3 


4600 


17 


11,0 


9,5 


20,5 


2,8 


8 


2 


00 


-1 


-1 


-1 


-1 


-1 


4 


4900 


-1 


8,0 


10,0 


18,0 


-1 


-1 


-1 


03 


-1 


-1 


-1 


3 


4 


3 


4400 


14 


20,0 


11,0 


31,0 


4,7 


-l 




04 


3 


3 


4 


-1 


-1 


-1 


4550 


12 


-1 


-1 


-1 


3,0 


2 


-1 


08 


4 


4 


4 


3 


4 


4 


5125 


34 


11,0 


13,5 


24,5 


4,3 


4 


4 


10 


“1 


4 


3 


2 


3 


5 


4750 


46 


14,0 


10,5 


24,5 


4,6 


16 


12 


05 


4 


5 


2 


-1 


-1 


-l 


54CO 


15 


-1 




-1 


3,0 


1 


-1 


00 


-1 


-I 


-1 


-1 


-1 


-1 


4575 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


08 


4 


5 


4 


4 


4 


3 


4925 


33 


-1 


-1 


-1 


4,1 


3 


16 


00 


-1 


-1 


-1 


-l 


-1 


-1 


4450 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


09 


3 


4 


2 


4 


2 


4 


4825 


33 


19,0 


9,5 


28,5 


4,2 


4 


-1 


02 


-1 


-I 


-1 


-I 


-1 


-1 


4575 


08 


14,0 


12,0 


26,0 


4,0 


-1 


2 


03 


-! 


-1 


-1 


-1 


-1 


-l 


4350 


10 


-1 


-1 


-1 


3,3 


-1 


-1 


09 


5 


4 


4 


5 


4 


4 


5100 


40 


16,0 


11,0 


27,0 


4,4 


1 


1 


07 


5 


4 


3 


-1 


-1 


-l 


4400 


28 


-1 


-1 


-1 


4,0 


4 


-1 


09 


4 


4 


2 


4 


4 


2 


4650 


27 


0,0 


10,5 


10,5 


3,0 


2 


1 


07 


4 


5 


2 


-1 


-1 


-1 


4400 


41 


20,0 


12,5 


32,5 


5,9 


8 


-l 


00 


-1 


-1 


-1 


-1 


-1 


-i 


4 864 


-1 


-1 


-1 


*1 


-1 


-1 


-1 


05 


3 


3 


4 


4 


4 


4 


4825 


21 


19,0 


10,5 


29,5 


4,2 


-1 


16 


03 


-1 


-1 


-1 


4 


5 


3 


4366 


12 


-1 


-1 


-I 


4,0 


-1 


2 


07 


2 


4 


4 


2 


4 


4 


5350 


30 


26,0 


12,5 


38,5 


4,3 


4 


2 


00 

ERIC 


-1 


*1 


-1 


“1 


-i 


-1 


4425 


-1 


-1 


-1 


-1 


-1 


-l 


-1 



,10 



* 



10 


4 


5 


4 


3 


3 


5 


4575 


47 


8,0 


9,0 


17,0 


4,7 


4 


2 


11 


3 


4 


3 


-1 


-1 


-1 


5175 


56 


18,0 


12,0 


30,0 


5,1 


3 


-1 


03 


-1 


-1 


-1 


-1 


-1 


-1 


4625 


08 


-1 


-1 


-1 


2,7 


-1 


-1 


06 


5 


3 


3 


4 


3 


4 


4575 


13 


-1 


-1 


-1 


2,2 


2 


-1 


02 


-1 


-1 


-1 


-1 


-1 


-1 


4575 


04 


-1 


-1 


-1 


2,0 


-1 


-1 


07 


3 


3 


2 


3 


3 


3 


4875 


28 


-1 


-1 


-1 


4,0 


8 


-1 


01 


4 


4 


5 


-1 


-1 


-1 


4475 


03 


-1 


-1 


-1 


3,0 


1 


-1 


04 


2 


4 


1 


-1 


-1 


-1 


4525 


11 


12,0 


9,5 


21,5 


2,8 


4 


-1 


01 


-1 


-1 


-1 


-1 


-1 


-1 


4650 


04 


-1 


-1 


-1 


4,0 


-1 


-1 


10 
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App. 6 



Correlation matrix for E ^-69 

Data comprise all 186 students starting the course in Spring Terra 1969. 

The correlation matrix was computed with the BHD programne 03D. The 
programme excludes the missing values which are marked -1. 
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App. 7 



Data stratified on variable No, 
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THESE ARE SY«MFTkIC MATRICES AND THE R r " ARE PRINTED IN HALF FORM, INCLUDING THE PRINCIPAL DIAGONAL 
A VALUE OF 99.0 INDI-A-Ei THE COEFFIC _ IT IS NOT COMPUTABLE DUE TO A ZERO DENOMINATOR. 
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VARIABLE A % ATT1I5 < ^PRINTED INTERVAL DESIGNATIONS ARE 

LOWER LIMITS OF CLASS 1NTERVALS< 
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VARIABLE 10 % T °ROBL < SPRINTEO INTERVAL DESIGNATIONS ARE 

LOWER LIMITS OF CLASS INTERVALS< 
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VARIABLE 13 T OP MED < SPRINTED INTERVAL DESIGNATIONS ARE 

LOWER LIMITS OF CLASS INTERVALS< 
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1, Attitude test I t February 1969 



2 , Attitude test II» May 1969 





i. 



At titude te s t I, E ^-69 (February 1969) 



What is your overall impression of this TV teaching compared with average 

50 % 

conventional teaching? 

a) much better 

b) rather better 

c) neither better nor worse 
6) rather worse 
e) much worse 




As aid in independent study the diagnostic tests v 

a) very good 

b) fairly good 

c) neither good nor poor 

d) rather poor 

e) very poor 




The pace of the IV programmes was as a rule 

a) much too quick 

b) rather too quick 

c) reasonable 

d) rather too slow 

e) much too slow 




5. 



The quantity of information in the TV programmes was 

a) much too great 

b) rather too great 

c) reasonable 

d) some additional matter could have been 
included 

e) much additional matter could have been 
included 
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ve 


ry good 


b) 


fa 
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re 
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ru 
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ve 


ry poor 
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6. I consider the length of the TV programmes was 

a) much coo short 

b) rather too short 

c) reasonable 

d) rather too Long 

e) much too long 




( 

0 



7. Comparing slides and TV for display cl diagnostic tests 1 think that 



a) TV is much better 

b) TV is rather better 

c) TV is as good as 

d) slides are rather better 

e) slides are much better 




The time allowed for answering of questions is, 3 think, on aveiage 

a) much too long 

b) rather too long 

c) reasonable 

d) rather too short 

e) much too long 




0 



Comments after answers to questions should consist of 

a) a thorough consideration oi each alternative 

b) a summary consideration of each alternative 

c) consideration only of the correct alternative 

d) merely indication of the correct alternative 




< \ 



10. If 1 were to repeat a course package 1 would ciost like a repetition of 

a) the TV programme 

b) the conventional lesson 

c) a mixed lesson with diagnostic tests and TV 

d) the course literature 

e) the circuit calculation exorcise 
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3 . 



n. 



As aid in my studies the laboratory expo 

a) very good 

b) fairly good 

c) neither good nor bad 

d) rather poor 

e) very poor 



into it 1 s 



50 % 




( 

O 



12. I should like the laboratory 

a) much more difficult 

b) more difficult 

c) as they are 

d) easier 

e) much easier 



experiments to be 




13. 



As preparation for each course package I have 

a) 0-14 min 

b) 15 - 29 min 
e) 30 - 59 min 

d) 1-2 hours 

e) >2 hours 




0 
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14. 



The reason for this time of preparation was 

a) to get through the diagnostic tests 

b) to prepare for the circuit calculation 
exercises 

c) special interest in the subject 

d) my normal method of study 

e) other reason 




15. 



1 thought the circuit calculation exercises were 

a) very good 

b) fairly good 

c) neither good nor poor 

d) rather poor 

e) very poor 
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At titude Lest II, fv.p-6^ (May I r * e ,J .) 



1. Wiiai is your overall impression oi this TV teaching compared villi 

SO % 

t; u 11 v out i. on a 1 1 e a c h x n g ? 

a) much hotter 

b) rather belli::!' 

c) neither better nor w..= rso 
0) rather worse 
c) much worse 
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I.) o you mi ss t h e 1 e c t u r o s v. r l u c h v: .*■ r e n 

a) yes 

b) no 

c) don't know 

The specification of the course object i 
package was an aid tfhich l utilized 

a) overv time 

b) usually 

c) sometimes 

d) occasionally oil tiial 
o) not at all 
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Vi's lo particular pages for each 




Should any of the following phases in the i caching bo go:n 
thoroughly, repealed, or piolongcd? 

a ) i’V 

b) DT 

e ) k xv r c i. s e s 

d) laboraloiy vxper Lmen t s 



till OUgh ThOVr 




Should any ol the following phases in th< 1 inching be shortened oi perhap 
v 1 i i d ii.it edV 

a) TV 

b) DT 

c) exercises 

d) labo rat ■■ ■ i v ">:nei i s.> uts 
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Would you like to have the IV pio^ranare repealed before the cxeivi; 

a) i it its on t. r ri t. y ^ 

b) thcoieticai 
i ) o u t s id e bio a d cast 
d) not at ail 
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Hu : 1 pace of the TV prognu.n/Os 

a) 1'iucl k loo quick 

b) rather tea quick 

c) reasonable 

d) rat ii or too slow 
ej much too slow 
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8 . 



The quantity of irLtoi rr.aL ion in 1 no 

a) much too great 

b) rather too great 

e) reasonable 

d ) s one addi t i cm a 1 n. 1 1 1 t> r < • < v, i J d 
I l a v e b e e n i n club e <. 1 

o) much additional matter ivu 1 d 
have been i n c 1 u d e d 
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<0 

c) 



aid ^.n independent study ihe 

very good 

fairly good 

neither good noi poor 

rather poor 

veiy poor 
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/'. The pace oi the 'IV programmes 

a) much I'Ou quick 

b) i a Li ter Loo quick 

c) reasonable 

d ) r a t h e r Loo s ) ow 

e) Much too slo\ 

8. The quantity of in i oma Lion i :: 
a) much too great 
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;;.0‘ till"* 'oi-’h t iso diagnosis 


tests? 














50 % 


;i) to a 


lar,;e , 


T. * 


. : f. 






£ j i *■■$. . 




b) pa i t 


i a ]. J y 










Ilf mi 


HIZI1Z 


c) not 


at ■>] L 










No 





I .. 



I-'*. 


1 1 iV o you v v. c o i v o d r, si i 


; f as: t. r i y ;uis 


* • is u- t-5 


If ykstioU 1 


s you a 


shod 


after the 




c i. a *»n os tin 1. e.-> t e ? 
















1 3 . i c o ! : a i d i ■ r the t i ?;ie .* i 1 1 o wo d i > i r a 

a) much Loo lon^ 

b) rather too Jon;’ 

c) i ensue. an io 

d) i.ithor too short 
o ) much too short 



wrriii,; ** i on s» * ■; on voi’-.i^e 
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19. 



o 

ERIC 



Confronts after answers to questions should consist of 

a) a thorough eonsiile rat ion of <. a eh .illonuh ivu 

b) a Mjitioary ounsi dural ion ol each nltoi nut ivo 





eons i 


.do ration ouV 


d) 


hjo ro 1 


y i n<l i cat i on 


Do 


yon nind s co i n i; y« 


a) 


I am 


a ware only e, 


b) 


snake s 


r.o uifforen 


c) 


annoy i ng 


d) 


very 


d i s t Ul b i i\\\ 


Dii 


\ yon 


have difficu 


a) 


„* *- s i 


always 


h) 


vos, 


occ.'is i on a 1 1 y 


c) 


no 




As 


preparation for e 


a) 


0 - 


I A in i n 


b) 


1 ) - 


29 run 


c) 


30 - 


39 nin 


d) 


1 - 


2 hours 


o) 


> 


2 hours 




j that they s e t? y on r ; 

50 % 





61 




! :i 0. 'I ho iv a s o a lor tins tv n 





a) 


Lo g 


el throng! 




b) 


*-0 p 


r op a iv fo 






oaic 


iiluli'n ir: 




O 


,: c o c 


ial in ten 




d) 


my n 


ornial met! 




e) 


otlie 


r re as or. 
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1 


th ou g 


h t tdi e c i 




a) 


very 


good 




L0 


fair 


ly good 




c) 


neither good i 




d) 


rath 


tr poor 




o) 


very 


poor 


y 1 1 


I 


cons i 


dev the c 




-0 


more 


1 heory 




b) 


more 


dot a i l c d 




O 


in- os 


out con lei 


2 3 , 


Wa 


s the 


number o 




a) 


t uo 


many 




b) 


re* so 


liable 




v:) 


tt>0 


lev 


2 , , 


3 1 i i 


at vj 


s the deg 




■i) 


l oo 


<iiff j.eu 1 1 




h) 


re as 


O' nab le 




c) 


t oo 


easy 


> t 


As 


a i d 


i.n r.iy slu< 




a) 


very 


good 




b) 


fai r 


3 y good 




o 


noi t 


hoi good i 




0) 


rat h 


or poor 




o) 


very 


poor 
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: a i y i i o ;>l i « t e s t > 
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•: fitly 
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e of difficulty of the calculation exerciser? 
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20 . 



The number ol laboratory experiments 

a) ;v ich Loo Large 

b) r '.i trier too large* 

c) reason ah 1 o 

d) rather too small 

e) much too small 




Z 



27 . 



I. should like the laboratory 

a) r,': a e h m o i e d i t f i c u 1 1 

b) more difficult 

c) as they arc 

d) easier 

e) much easier 



c x peri me n t s t o b e 










